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The  Combat  Scoring  Systems  (COMSCORS)  Workshop 
Walter  W.  Hollis,  Deputy  Un,<f6r  Secretary  of  The  Army  (Operations 
Research)  (DUSA(OR)l.  It  was ^conducted  12-14  November  1986  at  the 
Postgraduate  School.  Monterey,  CA.  The  main  objective  was 
evaluate  existing  weapons  scoring  systems  and 
for  and  desirable  characteristics  of  future 
of  Reference  are  at  Appendix  A. 
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in  his  keynote  speech  Mr.  Hollis  offered  five  general  items  of 
guidance  for  the  sessions: 

>  Shed  light  on  conceptual  issues. 

>  Focus  on  internal  consistency  rather  than  rigor. 

>  List  problems  that  should  not  be  addressed  with  scores. 

>  Determine  why  such  wide  variations  occur  in  the  application  of 
various  scoring  systems  and  the  sources  and  causes  of  these 
variations. 

>  The  goal  is  not  to  select  a  preferred  scheme. 

Conclusions 

The  workshop  reached  the  following  conclusions: 

>  Our  current  scoring  systems  do  not  suffice. 


>  We  do  not  know  how  to  fix  the  problems. 


>  We  must  develop  a  structured  approach  to  realise  acceptable 
methodologies  for  tractable  and  believable  value  systems  usable 
in  the  DOD  decision  processes  at  the  hierarchical  levels. 

Current  simple,  static  (and  easy  to  manipulate)  scoring  systems 
will  continue  to  be  used  (and  the  number  of  versions  of  these 
will  proliferate)  until  acceptable  alternatives  are  produced. 
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Resources  should  be  dedicated  and  fenced  NOW  if  any  progress  is 
to  be  made  in  this  area.  More  workshops  are  NOT  the  answer. 

Orgeni set  ion 

The  workshop  was  chaired  by  Professor  Sam  Parry  of  the  Naval 
Postgraduate  School.  CDR  Joe  Stewart,  also  of  the  Postgraduate 
School,  was  Co-Chair.  Dr  W.  Peter  Cherry,  Vector  Research,  Inc; 
Kenneth  Lavoie,  Air  Force  Wargaming  Center  at  the  Air  University 
and  Daniel  Shedlowski,  US  Army  Concepts  Analysis  Agency  were 
Working  Group  Leaders.  Other  participants  are  listed  in  Appendix 
B  . 

The  workshop  got  underway  in  a  General  Session.  Walter  Hollis 
delivered  the  keynote.  After  introduction  of  the  working  group 
leaders  and  delivery  of  the  charge,  the  working  groups,  Mathemat¬ 
ics,  Attrition  Processes  and  Non-Attrition  Processes,  went  to 
work  on  the  problem.  For  the  next  three  days  the  working  groups 
met  individually,  in  groups  of  two  and  in  general  sessions  to  air 
the  problem  and  develop  conclusions  and  the  recommendation.  The 
Agenda  is  at  Appendix  C. 

Overview  of  Workshop  Discussions 

As  expected,  the  first  day  was  spent  in  free-for-all  exploratory 
sessions  trying  to  establish  foundations  for  our  deliberations. 
The  members  of  the  workshop  represented  a  wide  variety  of  back¬ 
grounds  and  a  good  mix  between  mode  1 er s / ana  1 ys t s  and  users  of  the 
products.  There  was  little  disagreement  from  the  beginning  that 
static,  linear,  aggregated  scores  as  stand-alone  methodologies 
for  answering  questions  are  very  undesirable.  There  was  little 
initial  agreement  as  to  what  to  do  about  the  problem. 

On  the  second  day  it  was  proposed  and  accepted  that  we  would 
break  the  problem  into  two  components:  generation  and  interoretf- 
t-LOn  (see  Figure  1).  The  generation  component  is  the  producer  of 
quantitative  combat  measures  of  effectiveness,  subject  to  profes¬ 
sional  review,  verification,  and  (hopefully)  validation.  Inter¬ 
pretation  is  the  process  of  mapping  generation  component  outputs 
into  answers  to  specific  questions,  hopefully  subjected  to  pro¬ 
fessional  review  based  on  decision  and  utility  theory  notions  to 
provide  a  much  needed  audit  trail  through  the  process. 

A  second  fundamental  categorisation  of  the  relationship  of  deci¬ 
sion  classes,  force  sise  (model  resolution),  and  process  impor¬ 
tance  provided  a  very  useful  enhancement  to  viewing  the  problem 
(see  Figure  2).  Attrition  process  importance  decreases  (relative 
to  non-attrition  processes  as  force  sites  increase  from  battalion 
to  theater  level.  Also  the  questions  asked  (and  decisions 
required)  change  over  this  continuum.  Finally,  Figure  2  shows  an 
initial  categorization  of  non-attrition  processes  importance 
along  this  continuum. 


FIGURE  1 
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Probably  the  most  desirable  attribute  of  generation  models  is 
that  they  represent  the  dynamics  of  combat  over  time.  The  prod¬ 
ucts  of  generation  models  are  combat  measures  of  effectiveness 
(MOE)  such  as  dynamic  k i 1 1 e r - v i c t i m  (K/V)  scoreboard,  ammo  con¬ 
sumed,  advance  rates,  etc.  In  general  the  inputs  to  generation 
models  should  be  accepted  physical  system  measures  of  performance 
(MOP)  and  decision  rules  which  are  both  transparent  and  subject 
to  audit  trail  analysis.  We  all  know  that  an  MOP  at  one  level  may 
well  be  an  MOE  at  the  next  lower  level.  The  products  of  the 
generation  models  become  inputs  to  interpretation  "models."  The 
greatest  deficiencies  in  the  generation  models  today  are  the  lack 
of  internal  time  dependencies  of  the  decisions  made  by  the  sys¬ 
temic  models  (i.e.,  no  future  projection  state  variable  decision 
algorithms)  and  the  lack  of  believable  transitions  between  levels 
of  the  hierarchy. 

As  shown  in  Figure  1,  generation  models  are  represented  as  three 
basic  types : 

>  Large,  complex  models  such  as  the  Combined  Arms  and  Support 
Task  Force  (CASTFOREM),  Vector  in  Command  (VIC),  Force 
Evaluation  Model  (FORCEM),  TAC  THUNDER,  etc.,  used  to  pro¬ 
duce  dynamic  combat  MOE's  directly; 

>  These  same  models  used  to  produce  outputs  to  more  aggregated 
models  such  as  the  Combat  Analysis  Model  (COMAN),  ATCAL, 
etc. 
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To  date,  an  essentially  non-existent  family  of  simpler, 
stand-alone,  believable  force-on-force  models  which  produce 
more  situation  and  question  specific  outcomes  in  a  short 
response  time  environment  (caused  by  the  “realism  vs 
simplicity"  dilemma). 


FIGURE  2 
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As  distributed  processing  techniques  mature,  the  concept  of  a 
“self-contained  hierarchy"  of  generation  models  may  become  a 
reality.  This  realisation  will  occur  only  if  we  accept  the  fact 
that  software  design  and  development  must  be  initiated  at  least 
five  years  prior  to  its  implementation  (and  probably  longer, 
based  on  our  records).  Otherwise,  we  will  be  faced  with  outdated 
software  and  hardware  implementations  to  be  used  as  our  gener¬ 
ation  mode  1 s . 
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In  many  cases  interpretation  may  be  better  described  as  a  process 
than  as  a  model.  Interpretation  may  very  well  be  an  individual 
making  a  subjective  judgment  as  to  the  answer  to  a  question  based 
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on  a  generation  model  output.  That  output  may  consist  of  data 
generated  from  another  person's  impression  of  the  facts  which 
pertain  to  the  problem  at  hand  or  may  be  a  post-processor  of  a 
systemic  simulation  model.  Herein  lies  the  scope  of  the  problem 
we  face.  First  and  foremost,  the  process  recognizes  the 
existence  of  a  multiplicity  of  weighting  schemes,  whether  applied 
in  the  generation  or  interpretation  model.  In  addition,  the 
process  represents  the  utilization  of  dynamically  generated 
combat  MOE ’ s ,  coupled  with  appropriate  weighting  or  scoring  of 
these  MOE's,  to  arrive  at  an  answer  to  a  specific  question  or 
possibly  influence  a  decision  made  by  a  particular  decision 
maker  . 

First,  the  interpretation  model  must  either  explicitly  or  impli¬ 
citly  consider  those  factors  not  represented  in  the  generation 
model.  Secondly,  it  must  either  interpolate  or  extrapolate  the 
generation  model  results  to  the  particulars  of  the  question  or 
decision.  Thirdly,  the  process  must  either  explicitly  or  impli¬ 
citly  assign  weights  to  all  factors  related  to  the  question, 
whether  the  factor  was  accounted  for  in  the  generation  or  inter¬ 
pretation  model.  Keep  in  mind  that  the  interpretation  model  is 
nothing  more  than  a  quantitative  or  qualitative  application  of 
weighting  (value)  schemes  to  1IOE  results  from  whatever  the  form 
of  the  generation  model. 


The  use  of  static  scores  in  interpreters: 

>  Must  clearly  establish  context,  since  questions  are  clearly 
context  sensitive. 

>  Must  be  subject  to  rigorous  evaluation,  since  there  are  many 
valid  techniques  for  aggregation;  some  of  which  are  amenable 
to  mathematical  rigor,  some  are  not. 

>  Must  be  subject  to  evaluation  of  the  assumption  that  "linear" 
roll-up  of  results  from  the  generator  are  acceptable  with 
values  attached  to  dynamically  produced  outcomes. 

>  Could  be  used  to  assign  "values"  to  weapon  systems  IN 
CONTEXT  for  a  SPECIFIC  decision,  for  analysis  purposes. 


>  Must  strive  to  establish  an  understandable  and  believable  link  >.^j 

between  analysts  and  decision  makers  by  providing  a  structure 

which  accommodates  the  decision  makers'  preference  for  value  i 

and  risk. 
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Weapons  Effectiveness  I ndex /We  1 gh t ed  Unit  Value  (WEI/WUV)  and 
similar  static  scoring  systems  are  a  product  of  a  qualitative 
attempt  to  deal  with  problems  yet  unsolved  by  the  analytical 
community.  It  is  not  clear  that  the  "decision  making  community" 
desires  a  quantitative  basis  for  scoring,  even  if  such  a  system 


were  possible.  It  may  very  well  be  that  the  problem  lies,  not  in 
the  development  of  quantitative  scoring  systems,  but  in  the  fear 
by  the  community  that  many  "tuning  parameters"  may  be  removed 
from  the  process.  In  this  regard,  we  must  face  the  problem  of 
what  can  realistically  be  considered  quantitatively  and  what  must 
be  left  as  judgmental  overlays,  both  in  the  generation  and  inter¬ 
pretation  processes. 

Use  of  models  today  is  reactive  to  study  demands,  not  proactive 
to  fill  the  void  required  of  generation  models  to  feed  interpre¬ 
tation  mode  1 s  . 

Linear,  static,  aggregate  scores  that  are  not  based  on  acceptable 
generation  model  outputs  are  not  desirable  for  either  attrition 
or  non-attrition  analysis. 

The  need  for  macro,  quick  turn  around  analysis  me t hods / t oo 1 s  that 
are  objectively  based  is  not  currently  being  filled. 

The  majority  of  models  are  used  for  purposes  other  than  providing 
macro/analytic  methods. 

Limitations  of  Static  Scores  as  generators:  (a)  dynamics  of 
combat  are  not  included,  but  are  critical,  (b)  impossible  to 
analyse  cause  and  effect,  hence  negating  audit  trail  analyses, 
(c)  no  assessment  of  uncertainty,  Cd)  mathematically  bankrupt  as 
generators  of  results  and/or  proxies  for  same,  (e)  context  of  the 
static  score  both  limited  and  uncertain  (i.e.,  what  is  the  con¬ 
text  of  this  number  I  am  about  to  use?). 
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Separate  generation  and  interpretation  functions. 

Identify  specific  requirements  for  new  generation  models  and  for 
proactive  use  of  existing  ones.  This  requires  a  new  focus  not 
currently  present  in  the  management  and  use  of  our  analytical 
tools.  The  first  task  of  the  proposed  group  dedicated  to  generat¬ 
ing  the  architectural  solution  to  our  problem  is  to  determine  the 
new  focus.  As  a  first  cut  a  new  focus  implies  using  our  analyti¬ 
cal  tools  for  applications  beyond  the  boundaries  of  the  agency 
which  owns  and  executes  the  tool  to  satisfy  imposed  study 
requirement  deadlines.  This  suggests  a  totally  new  "chain  of 
command"  to  facilitate  the  integration  of  generation  and  inter¬ 
pretation  models  across  Army,  Air  Force,  Navy,  and  joint  analy¬ 
sis. 

Define  the  products  required  of  the  generation  and  interpretation 
models;  what  we  have  in  hand  today;  and  what  we  need  to  fill  the 
voids.  Obviously,  one  of  our  major  problems  today  is  timeliness 
of  response  vs  an  ever  increasing  demand  for  "realism,"  hence 
comp  1  ex i t  y . 

"Model  in  every  pot"  is  not  the  answer,  especially  with  the 
advent  of  micro  computers  at  almost  every  level  of  command.  The 


micro  explosion  forces  us  as  the  “analytical"  community  to  deter¬ 
mine  and  recommend  the  appropriate  use  of  this  explosion.  Cur¬ 
rently  we  are  well  behind  the  power  curve  to  assist  the  opera¬ 
tional  community  in  this  regard. 

Must  initiate  a  focused  effort  to  develop  alternative  macro 
analytic  methods  to  judgmental  scores  for  the  generation  model 
process,  a  currently  unfilled  challenge  to  the  modeling  commu¬ 
nity. 
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We,  as  modelers,  have  “copped  out"  long  enough.  The  reason  our 
products  require  so  much  interpretation  is  that  we  have  focused 
on  the  "easy  phy s i cs /eng i nee r i ng"  modules  and  have  not  focused  on 
the  hard  parts  such  as  decision  making,  support  functions,  delay 
implications,  etc.  We  must  walk  a  fine  line  in  our  generation 
models  between  "tuning  parameters"  and  those  which  can  be  sub¬ 
jected  to  either  data  or  sensitivity  analyses  considerations.  We 
have  been  in  the  "band-aid"  mode  far  too  long.  Our  "comfort 
zone"  approach  is  no  longer  acceptable  if  we  are  truly  dedicated 
to  a  viable  alternative  to  the  current  way  of  doing  business. 
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Identify  precisely  who  the  current  users  of  static  scores  are  and 
the  specific  decisions  with  which  they  deal. 


For  each  of  these,  design  an  alternative 
concepts  described  in  the  previous  section. 


approach  using 


Develop  a  catalog  of  appropriate  generation  models  (not  the 
all-inclusive  book)  which  focuses  on  the  interpretation  models  it 
could  feed  and  the  associated  ques t i ons /dec i s i ons  it  could  sup¬ 
port. 

Clearly  identify  which  key  decision  parameters  are  included  in 
generation  vs  interpretation,  along  with  a  concise  specification 
as  to  how  each  is  considered  in  the  analysis. 

Develop  some  "menu  driven"  interpretation  models  appropriate  for 
specific  classes  of  decisions.  IT  MAT  BE  THAT  A  LINK-UP  WITH  THE 
MODERN  AIDS  TO  PLANNING  PROGRAM  (MAPP)  GROUPS  MAT  SERVE  A  USEFUL 
PURPOSE  IN  THIS  REGARD. 

To  the  extent  possible,  develop  quantitative  linkages  and  coordi¬ 
nation  between  specific  generation  and  interpretation  models. 
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Net  assessment  applications  of  scores  may  be  piece-wise  linear, 
obviously  requiring  a  disciplined  approach  to  use  of  current 
scoring  sys  terns . 


Immediately  stop  development  of  static  scores  as  generators  and 
focus  these  resources  on  explicit  methods  for  assigning  weights, 
consistent  with  a  formal  structure,  which  directly  relate  to 
dynamic  MOE ’ s  produced  by  acceptable  generation  models. 


Recognize  that  the  transition  will  not  occur  over  night.  It 
represents,  to  some  users,  a  new  way  of  doing  business. 


Establish  an  appropriate  group  to  continue  deliberations  and  make 
concrete  recommendations  to  the  DUSA-OR .  This  group  should  be 
established  as  soon  as  possible  to  assure  that  the  motivation  for 
solution  to  this  dilemma  is  not  lost. 
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You,  as  the  decision  maker,  must  provide  enough  information 
regarding  the  question  so  that  the  analyst  can  formulate  quanti¬ 
tatively  attainable  MOE ' s  to  address  the  question.  You,  as  the 
analyst,  must  establish  the  link  to  the  decision  maker  in  terms 
of  value  and  risk  associated  with  the  question,  as  well  as  in  the 
context  of  the  answer  required.  Static  scores  are  an  artifact  of 
our  OR  past,  yet  they  remain  a  fixture  in  our  current  decision 
process.  Is  this  the  fault  of  our  current  generation  models,  our 
lack  of  future  state  forecasting  capabilities,  or  is  this,  in 
fact,  not  a  fault  at  all?  The  answer  lies  in  a  direct  confronta¬ 
tion  of  the  problem  by  both  the  decision  making  and  the  analysis 
commun i t  y . 


m 


v*.r»*«*.c*  f 


APPENDIX  A 


TERMS  OF  REFERENCE 


MORS  WORKSHOP  ON  COMBAT  SCORING  SYSTEMS 


A 


A 


£ 


I 

k 


TERMS  OF  REFERENCE 


MORS  WORKSHOP 
on 

STATIC  WEAPONS  SCORES 


Background 

The  Military  OR  community  and  those  decision-makers  who  use 
its  products  have  long  felt  the  need  for  a  relatively  simple  sys¬ 
tem  of  measures  of  effectiveness  for  weapons,  units,  and  forces  to 
use  in  net  assessments,  trend  analyses,  simple  models  of  conflict, 
prioritization,  and  for  other  purposes.  Typically,  the  general 
concept  underlying  these  systems  is  that  each  weapon  has  an 
associated  "score"  and  these,  with  appropriate  modification,  can 
be  summed  to  get  a  total  score  for  a  unit  or  a  force.  The  history 
of  the  development  of  the  scores  is  a  long  one,  and  the  degree  of 
sophistication  of  the  various  schemes  ranges  from  simple  counts  of 
people  and  weapons  to  those  requiring  a  catalog  of  results  of 
computer  simulations  and  games.  Although  some  analysts  have 
called  for  the  abolition  of  this  kind  of  simple  measurement,  and 
others  have  questioned  the  specific  uses  for  which  they  are  being 
computed,  they  have  been  and  will  continue  to  be  used  to  assist  in 
many  decision  processes. 

Because  of  the  degree  of  disagreement  within  our  community  as 
to  the  validity  and  appropriate  use  of  such  scores,  the  Deputy 
Under  Secretary  of  the  Army  (Operations  Research)  has  suggested, 
and  the  MORS  Board  of  Directors  has  approved  in  concept,  the 
convening  of  a  Workshop  on  Static  Weapons  Scores  (Force  Potential 
MOE)  to  be  held  in  November  1986. 

Objective 


The  main  objective  of  this  workshop  is  to  discuss  and  evalu¬ 
ate  existing  weapon  scores  and  estimate  the  need  for  and  desirable 
characteristics  of  future  measures  of  this  kind.  It  is  hoped  that 
a  wide  range  of  agencies  will  be  represented,  including  each  of 
the  Military  Services,  OSD,  OJCS ,  CIA,  DIA,  and  civilian 
contractors . 

Scope 


The  workshop  will  entertain  discussion  of  the  many  weapon  and 
unit  scores  in  existence,  their  methods  of  development,  and  the 
relationship  between  the  MOE  and  their  intended  and  actual  use. 
Both  those  designed  for  independent  (static)  use  and  those 
designed  to  input  to  dynamic  combat  models  will  be  considered. 
Among  the  questions  that  might  be  addressed  are: 


o  Is  there  a  basis  in  historical  data  to  validate  the 
use  of  a  particular  set  of  scores  for  a  particular  purpose?  For 
example,  many  aggregated  combat  models  use  ratios  of  scores  to 
drive  the  commander's  decision  process  and  to  assess  unit  level 
combat  outcomes  and  FEBA  movement.  Some  analyses  have  attempted 
to  correlate  casualty  rates  and  FEBA  movement  with  force  ratios 
using  historical  data,  but  with  little  success. 

o  Is  there  a  set  of  problems  for  which  scores  derived 
from  s i mu  1 a t i on - ba sed  killer /victim  scoreboards  are  both  useful 
and  valid?  What  are  the  mathematical  difficulties  with  this 
approach  ? 

o  Does  the  creation  of  model  hierarchies  obviate  the 
need  for  aggregated  weapon  scores?  If  not,  how  do  we  accomodate 
them  in  models  of  different  degrees  of  resolution? 

o  What  are  the  alternatives  to  expressing  the  value  of 
a  unit  as  a  linear  or  non-linear  combination  of  that  unit's 
individual  weapon  scores?  The  very  concepts  of  "unit"  and 
"combined  arms"  are  based  on  the  idea  that  we  can  add  to  effec¬ 
tiveness  by  the  way  we  organize  and  train.  How  can  scores 
represent  this  dependence  of  effectiveness  on  mix? 

o  Similarly,  what  are  the  alternatives  to  expressing 
the  value  of  a  force  (air,  ground,  and  naval)  as  a  combination  of 
unit  scores? 

o  How  and  to  what  extent  can  and  should  a  unit's  score 
be  modified  to  represent  different  activities  and  locations  on  the 
battlefield? 

o  To  what  extent  can  the  value  of  a  weapon  system  be 
expressed  as  a  weighted  sum  of  selected  characteristics  (mobility, 
survivability,  lethality,  etc.)  of  the  system?  Can  we  add  to  the 
validity  of  this  approach  by  computing  multiple  sets  of  values? 

o  Are  there  particular  categories  of  weapon  systems  to 
which  scores  should  be  applied  when  simulating  decision  making? 

Do  these  categories  vary  with  the  tactical  echelon  and  the 
tactical  mission  of  the  simulated  decision  maker?  Are  there 
categories  of  decisions  for  which  weapon  scores  should  not  be 
used  ? 

o  In  the  simulation  of  the  decision-making  process, 
when  should  the  static  scores  for  the  simulated  decision  maker  be 
computed  on  the  current  status  of  the  force,  and  when  should  they 
be  based  on  a  projected  force  status  related  to  execution? 

The  scope  of  the  workshop  does  not  include  the  endorsement  of 
specific  methods  or  approaches,  although  individual  participants 
will  be  encouraged  to  provide  examples,  insights,  suggestions  for 
improvement,  etc.  Similarly,  the  scope  does  not  include  recom¬ 
mendations  for  changes  in  specific  ongoing  efforts,  but  the 


results  of  the  workshop  should  provide  a  better  foundation  of 
understanding  on  which  to  base  such  changes. 

Agenda 


It  will  be  the  responsibility  of  the  chair  to  develop  a 
detailed  agenda.  It  is  envisioned  that  there  will  be  a  general 
session  devoted  to  the  education  of  participants  as  to  what  - 
measures  have  been  and  are  being  used  and  for  what  purposes.  The 
workshop  would  then  divide  into  sub-groups  for  detailed  discussion 
of  the  issues.  While  the  composition  of  the  sub-groups  will  be 
left  to  the  discretion  of  the  chair,  one  possible  division  is: 

o  Mathematical  issues. 

o  Use  of  weapon  scores  in  dynamic  models. 

o  Use  of  static  measures  independent  of  dynamic  models. 

After  separate  subgroup  meetings,  the  entire  workshop  will 
then  reconvene  to  report  findings,  to  integrate  results,  and  to 
prepare  a  draft  paper /brief ing  of  the  highlights.  The  chairs  of 
the  workshop  and  subgroups  will  meet  after  the  workshop  to  the 
extent  necessary  to  finish  a  timely  white  paper,  article  for 
PHALANX,  and  a  briefing. 

Membership 

The  workshop  chair  will  be  Dr.  Sam  Parry,  from  the  Navy 
Postgraduate  School.  The  chair  will  control  membership  so  that  it 
falls  in  a  range  of  35  to  45.  Active  use  will  be  made  of  members 
of  appropriate  MORS  working  groups.  From  applicants  responding  to 
the  announcement  of  the  workshop,  priority  will  be  given  to  those 
individuals  with  the  most  relevant  experience  bearing  on  the 
discussion  of  static  weapons  scoring  systems. 
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APPENDIX  B 
ATTENDEES 

MORS  WORKSHOP  ON  COMBAT  SCORING  SYSTEMS 


ATTENDEF  AT  COMSCORS  WORKSHOP 
November  12-14  1986 


Mr .  Fred  Af  f eldt 
Boot,  Allen  &  Hamilton 
1725  Jefferson  Davis  Hwy 
Suite  1100 

Arlington,  VA  22202  4158 

(703)  769-7774 


Dr  .  George  Ales  t 

Marine  Corps  Ops  Analysis  Grp 

Center  for  Naval  Analyses 

4401  Ford  Ave-ue 

Alexandria,  VA  22302  0268 

(703)  824-21 U6 


Dr.  Lowel  B.  Anderson 
Institute  for  Defense  Analyses 
1801  N.  Beauregard  Street 

A 1 exa i  . r i a  ,  VA  22311 

(7031  845-2148 


Mr  Daniel  P.  Barker 

AFCSA/SAGF 

The  Pentagon 

Washington,  DC  20330  5420 

(202)  697-5616 


LtCol  Vernon  M.  Bettencourt 
ODUSA,  Attn:  SAUS  OR 
The  Pentagon.  Room  1E643 

Washington,  DC  20310  0102 

(202)  697-0367 


Edward  C.  Brady 
The  MITRE  Corporation 
7525  Col shi re  Drive 
MS  Z60S 

McLear ,  VA  22102 

(703)  883-6201 


Dr.  W.  Peter  Cherry 
Vector  Research,  Inc. 

PO  Box  1506 

Ann  Arbor,  Ml  48106 

(313)  973-9210 


Mr.  Gordon  K.A  Coleman 

TRAC-Monte  rey 

Naval  Postgraduate  School 


Monterey,  CA  93943 

(408)  646-3087 


Mr.  Michael  W.  Davis 

HQDA,  ODCSOPS 

The  Pentagon.  Room  3A538 

Washington,  DC  20310  0410 

(202)  695-9091 


Mr .  Mi chae 1  D .  Flint 
CIA 


Washington,  DC  20505 

(703)  482-2599 


Mr.  Richard  E.  Garvey,  Jr. 
BBN  Laboratories,  Inc. 
c/o  SIMNET 
PO  Box  667 

Ft  .  Knox  ,  KY  40  1  2  1 

(502)  942-1092 


LTC  William  W  Hansen,  USA 

HQDA,  OCSA 

DACS-2BAS 

The  Pent  agon , Room  3C641 
Washington,  DC  20310 

(202)  697-8557 


Mr .  Walter  W.  Hollis 
DUSA/OR 

The  Pentagon,  Room  2E660 

Washington,  DC  20310 

(202)  697-0083 


Robert  D.  Howe 

The  Rand  Corporation 

2100  M  Street .  NW 

Washington,  DC  20037  1270 

(202)  296-5000 


I 


Prof.  Wayne  P.  Hughes,  Jr 
Naval  Postgraduate  School 
Code  55  HI 
Department  of  OR 
Monterey,  CA  93943 

(408)  646-2484 


MAJ  (P)  C.  Warner  Jackson 
HQ  USC I NCPAC 
J  5  5 ,  Box  15 

Camp  H.M.  Smith.  HI  96861  5025 
(808)  477-6667  AV  421-6667 


CPT  Robert  Kilmer,  USA 
HQ  TRADOC 

DCS  for  Combat  Developments 
Attn:  ATCD-AC 

Ft .  Monroe ,  VA  23651  5000 

(804)  727-3005 


Mr.  Kenneth  E.  Lavoie 

AUCADRE/WGT 

Bldg  1406 

Maxwel 1  AFB ,  AL  36112 

(205)  293-6528 


MAJ  David  B.  Lee,  USAF 
Air  Force  Wargaming  Center 
AUCADRE / WGTA 

Maxwell  AFB.  AL  36112  5532 

(205)  293-6528 


Mr .  Philip  E .  Loue  r 

USA  Concepts  Analysis  Agency 

8120  Woodmont  Avenue 

Bethesda ,  MD  20814  2797 

(301)  295-1692 


Mr.  Louis  Robert  Moore,  III 
The  Rand  Corporation 
1700  Main  Street 


Santa  Monica, 
(213)  393-0411 


CA  90406  2138 


Mr .  Peter  G .  Nelson 
OSD  ( P  A&E ) 

OSD (DPA&E )GPP ( LFD) 

The  Pentagon,  Room  2B256 
Washington,  DC  20301  1800 

(202)  697-3521 


Mr.  Thomas  E.  Nolan 
USAMSAA 

Attn:  AMXSY-CC 

Aberdeen  PC,  MD  21005  5071 

(301)  278-6610 


Prof.  Sam  Parry 

Naval  Postgraduate  School 

Code  55  Py 

Monterey,  CA  93943 

(408)  646-2779 


MAJ  Dan  Reyen 
AF1T/ENS 

Engr  &  Operational  Sci.  Dept 

WPAFB ,  OH  45433 

AV  785-3362 


MAJ  C.  Parks  Schaefer,  USAF 
AUCADRE / R I C-MAC 

Bldg  1400 

Maxwell  AFB,  AL  36112  5532 

(205)  293-6141 


Dr.  Dan  Shedlowski 

USA  Concepts  Analysis  Agency 

8120  Woodmont  Avenue 

Be thesda .  MD  208  14 

(301)  295-1532 


Mr.  John  E.  Shepherd 
OJCS/JAD 

The  Pentagon,  Room  1D928A 


Washington, 
(202)  694-7881 


DC  20301  0102 


Mr.  Peter  A.  Shugart 
USA  TRAC-WSMR 
Attn:  ATOR-TD 

WSMR ,  NM  88002  5502 

(505)  678-3823/2937 


Dr.  Chris  Simonson 
Lawrence  Livermore  Natnl  Labs 
Attn:  L315 

PO  Box  800 

Livermore,  CA  94550 

(415)  422-6569 


LTC  John  D.  Spengier 
HQ  USEUCOM  ECJ5-E 
PO  Box  17 

APO  New  Yo. X  NY  09 1 28 

49-711-680-5354  AV  430-5353 


CDR  Joe  Stewar  t ,  USN 
Naval  Postgraduate  School 


Monterey,  CA  93943 


Mr.  George  E.  Thompson 
ANSER 

1215  Jefferson  Davis  Hwy 
Suite  800 

Arlington,  VA  22202 

(703)  685-3189/3181/1000 


Mr .  Keith  Thor p 

National  Defense  University 

NDU- 1 NSS-WGSC 

Fort  McNair,  DC  20319 

(202)  475-1251 


John  C.  Traynham 
Boeing  Military  Airplane  Co 
MS  K 16-14 
PO  Box  7730 

Wichita,  KS  67277  7730 

(316)  526-3858 
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Mr .  William  J .  Vogt 
The  Analytic  Sciences  Corp 
1700  N.  Moore  Street 
Suite  1 220 

Ar 1  ington ,  VA  22209 

(703)  558-7415 


COL  Kenneth  E.  Wiersema 

Army  Model  Improve.  Mgt  Office 

AMMO 

Attn:  ATZL-CAN-DO 

Ft.  Leavenworth,  KS  66027  7400 

(913)  684-4919/2734 


Richard  I.  Wiles 
MORS 

101  S.  Whiting  Street,  *202 


Alexandria, 
(703)  751-7290 


VA  22304 


MAJ  Charles  H.  Williams,  USA 
USA  Concepts  Analysis  Agency 
8120  Woodmont  Avenue 


Bethesda  , 

(202)  295-5273 


MD  20814  2797 
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APPENDIX  C 
AGENDA 

MORS  WORKSHOP  ON  COMBAT  SCORING  SYSTEMS 


COfIBAT  SYSTEMS  SCORING  WORKSHOP 
AGENDA 


WEDNESDAY  —  12  NOVEMBER  nflb 


0745 

ARRIVE  NAVAL  POSTGRADUATE  SCHOOL  --  CHECK-IN-, 

MAIN  LOBBY-,  INGERSOLL  HALL 

MORS  OFFICE 

0615 

CONVENE-,  INTRODUCTION  —  INGERSOLL  122 

SAM  PARRY 

0645 

HOST  WELCOME 

ADMIRAL  AUSTIN 

MORS  WELCOME 

DICK  GARVEY 

0000 

KEYNOTE 

WALTER  HOLLIS 

0030 

INTRODUCTION  OF  WORKING  GROUP  LEADERS 

CHARGE  TO  GROUPS 

SAM  PARRY 

ADMINISTRATIVE  ANNOUNCEMENTS 

DICK  WILES 

JOE  STEWART 

01 MS  BREAK 

1015  PRESENTATION  OF  WORKING  GROUP  GOALS 
•CIS  MINUTES  EACH} 

1100  LUNCH  —  NPS  OFFICERS  CLUB 

1215  WORKING  GROUPS  CONVENE 

MATHEMATICS  —  INGERSOLL  3bl 
ATTRITION  PROCESSES  —  INGERSOLL  325 
AT  1300  —  INGERSOLL  323 
NON-ATTRITION  PROCESSES  —  INGERSOLL  122 

1430  BREAK 

1700  WORKING  GROUPS  ADJOURN  IWG  LEADERS i  FLOATERS  MEET 

WITH  SAM  PARRY  IN  122} 

1715  MIXER  —  NPS  OFFICERS  CLUB  —  LA  NOVIA  TERRACE  ROOM 


THURSDAY  —  13  NOVEMBER  ll&h 
0745  COFFEE  AND  DONUTS  —  OUTSIDE  INGERSOLL  122 

0630  CONVENE  —  INGERSOLL  122  --  ADMINISTRATIVE  ANNOUNCEMENTS  SAM/DICK 

0640  SPECIAL  PRESENTATION  —  GENERALIZED  VALUE  SYSTEM  —  CPT  BOB  KILMER 

NPS  RESEARCH 

0*520  OTHER  SCORING  SYSTEMS  WAYNE  HUGHES 


WOPKING  GROUP 
LEADERS 


0145 


BREAK 


0R5S 


PRELIMINARY  WG  REPORTS  CBO  F1INUTES  EACH> 


WG  LEADERS 


1100 
IE  15 
1430 
1700 

IflOO 

MOO 

0745 

OflOO 

OIOO 

1100 

1E15 

1415 

1500 

1500 

COfiniTTEE 


LUNCH 

WORKING  GROUPS  CONVENE  AS  ON  WEDNESDAY 
BREAK 

WORKING  GROUPS  ADJOURN  -CWG  LEADERS ,  FLOATERS  MEET 
WITH  SAM  PARRY  IN  IBB} 

COCKTAILS  AT  THE  MARK  THOMAS  OUTRIGGER 

DINNER  AND  INTERACTION  WITH  BRUCE  ARISS 

FRIDAY  —  14  NOVEMBER  Mflb 
COFFEE  AND  DONUTS  —  OUTSIDE  INGERSOLL  IBB 
WG  REPORTS  —  INGERSOLL  IBB  CBO  MINUTES  EACH} 
WORKING  GROUPS  RECONVENE  —  SAME  ROOMS 
LUNCH 

WG  REPORTS  —  INGERSOLL  IBB C  40  MINUTES  EACH} 

SUMMARY 

ADJOURN 

INITIATE  PREPARATION  OF  REPORT  AND  BRIEFING 


CHAIR  —  SAM  PARRY-,  NAVAL  POSTGRADUATE  SCHOOL 
COCHAIR  —  CDR  JOE  STEWART  ,  NAVAL  POSTGRADUATE  SCHOOL 

WG  LEADERS  — 

MATHEMATICS  —  PETER  CHERRY,  VECTOR  RESEARCH  INC- 
ATTRITION  PROCESSES  —  DAN  SHEDLOWSKI,  USA  CAA 
NON-ATTRITION  PROCESSES  --  KEN  LAVOIE,  AU/CADRE 


WG  LEADERS 


WG  LEADERS 


SELECTED  PERSONS 


